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Abstract In Network cooperative games, due to computational complexity 
issues, agents are not able to base their behavior on the "whole network 
status" but have to follow certain "beliefs" as to how it is in their strategic 
interest to act. This behavior constitutes the main interest of this paper. 
To this end, we quantify and characterize the set of beliefs that support 
cooperation of such agents. Assuming that they are engaged in a differenti- 
ated Cournot competition and that they equally split the worth produced, 
we characterize the set of coalitional beliefs that support core non-emptiness 
and thus guarantee stability of the Network. 
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1 Introduction 

Game Theory has nowadays become a frequent research tool to approach 
Network Science. Ideas like Nash equilibrium, price of anarchy and stability, 
cost allocation, transferable utilities, coalition formation, core, mechanism 
design, to name a few, are commonly used not only to understand the be- 
havior of complex network phenomena but also to control and efficiently 
design such networks. See, for example, Chapter 10 in [lj for a recent sur- 
vey. Under the above setting, usually there exists an underlying network 
in which some agents (or otherwise stated, players, nodes, firms, etc.) are 
linked according to certain relationships and compete following specific rules 
in order to optimize a self-interested utility (price, bandwidth, network flow, 
etc.). However, as many of the real life problems map to large and complex 



networks [2J, our bounded computational ability and known intractability 
results [21 H] restrict our potential to fully unfold and understand coalition 
formation in networks. 

Due to this complex environment network agents are not able to base 
their behavior on the "whole network status" but have to follow certain be- 
liefs as to how it is in their strategic interest to act. This behavior has gained 
a lot of attention and such agents are extensively used in Network science 
[HI IH El El El IH] • These agents constitute the main interest of this paper. 
To this end, we quantify and characterize the set of beliefs that support co- 
operation of such agents in a network. In order to illustrate our ideas, we 
force the agents to compete under a Cournot competition. We also agree 
that in order to conceive of a group of fully cooperating agents we will use a 
complete graph (clique). We suppose that at the begining of the competition 
all the agents, say N, are fully cooperating and form a large clique or in game 
theoretic terms, the grand coalition. We then try to answer the following 

Basic Question: Which are the coalitional beliefs of the agents that support 
network stability? 

By network stability we mean the situation in which every agent cooper- 
ates with every other agent and no relationship between any two is broken 
(thus no edge is missing from the graph - network). 

In the rest of the paper we proceed as follows: In section 2 we present our 
model, in sections 3, 4 we present our results and in section 5 we conclude. 

2 The model 

Consider a set of agents N = {1, 2, • • • ,n} which are the nodes of a graph G. 
Suppose that these agents are engaged in a cooperative game which we will 
soon define. Whenever two agents l,m, 1 < l,m < n, cooperate, we draw 
an edge between the corresponding nodes in G. The graph describing all the 
cooperations between all the agents in N forms the network. It is clear that 
when every agent cooperates with every other, then the network is modeled 
by the complete graph (clique) of n nodes. In this case we say that the 
agents form the grand coalition. It is also clear that, unless otherwise stated, 
every non empty subset of agents S G N that fully cooperates also forms a 
complete subgraph, of G, with s = \S\ nodes. Let Vj denote a partition of the 
outsiders, N \ S, such that j 6 {1, 2, ■ ■ • , n — s} and Vj = {Si, S 2 , ■ ■ ■ , Sj}, 
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where {J S { = Vj and S t n S m = 0, V/ ^ m, 1 < l,m < j. We call Vj, 

l<i<j 

a coalition structure with j coalitions. Let s r = \S r \, r = 1,2, • • • , j, denote 
the number of agents in S r . 

The N agents are put together in order to cooperate under a Cournot 
competition, in which everyone must decide how much "product" to produce, 
all decisions have to be made at the same time, and each one must take its 
competitors into account. Each agent i e N, produces with the cost function 

n 

C{Qi) = c ' Qi an d with price function Pj = a — qi — 7 E Qj-> where is the 

quantity produced. The form of Pj implies that we use product differentiation 
in the Cournot competition where a > is a constant, c, < c < a, the per 
unit cost and 7 G (—1, 1] a non zero constant. Let v^(S) denote the total 
worth (or value or profit or payoff) of coalition S when S faces coalition 
structure Vj. Finally, in order to simplify the exposition assume, without 
loss of generality, that S — {1, 2, • • • , s}, Si — {s + 1, s + 2, • • • , s + Si}, 
3-1 

» = i> + E s w + 1, • • • 

«>=i 

Consider now the following scenario: a non empty set S C iV of agents 
considers not cooperating with the rest and wishes to deviate or in other 
words disconnect from the initial network (grand coalition). This would 
result in a split of the network into (at least) two disconnected components, 
the complete subgraph induced by S = {1,2, ••• , s} and the rest of the 
network denoted by N \ S (the outsiders). Since the consideration of S not 
to cooperate constitutes a threat for network stability (the grand coalition 
will break if S manages to deviate), decisions have to be made as to whether 
specific actions should take place. What would S finally do? The reasonable 
thing to do is for the agents of S to calculate their worth, a task not trivial 
at all. This is because their worth depends on how the rest of the network 
would act. Namely, it depends on the coalition structure that the outsiders 
N\S will form. 

3 The worth function 

As stated above, we now consider the scenario where a coalition S contem- 
plates breaking off from the grand coalition. What are the coalitional beliefs 
of the agents in S7 In order to answer this we have to reason on what the 
outsiders, n — s = \N\S\, will do. Assume that agents in S believe that the 
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rest will form j G {1, 2, • • • , n — s} coalitions. Since agents compete with each 
other, everyone faces an optimization problem, the solution to which gives 
the Nash equilibria describing the worth of each agent in the network when 
the grand coalition forms. Every agent needs to maximize his worth which is 
given by the formula: w orth= (price- cost)x quantity produced. Since agents 
in every coalition are symmetric, in order to select how much quantity they 
should produce, they face respectively the following optimization problems: 

agents in S 

, A s 

max J^(a - ft - 7 ft - c)ft 

(9l)ies i€S ieN,i& 

and 



outsiders in Sk, k = 1.2, ■ ■ ■ .j 

, " ■ ■ V 

max (a - q h - 7 ^ ft - c)q h 
(g h )hes k h£Sk ieN,&h 

One of the ideas that underlies the above problems is that due to sym- 
metry we do not have to solve the same problem for every agent in the same 
coalition. Instead we can treat every different coalition as a "super agent" 
and solve the problem concerning him. This approach is common in such 
problems (see for example [ID])- We have the following 



Theorem 1 If coalition S faces structure Vj and 7 > — j-, then there exist 
real numbers Xq, ■ ■ ■ , Xj such that the worth of S is 

< J (S) = *(l + 7*-7)(^) 2 (1) 

where C = 2[1 + 7(3 - 1)] + 7 £ f A . 

fc=i k 

Proof: For the proof we will need the condition K : 7 > -^j which guaran- 
tees the existence of Cournot equilibrium when 7 G (—1,0). The first-order 
conditions for the optimal quantities of the members of S read 

n 

2 qi = a - c - 27 ^ Qi ~ 7 5^ qk ' i E S 

ies,i^i k=s+i 
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and for each Sf., k = 1 , 2 , . . . , j , 



2q h = a - c - 27 22 Qt ~ 1^ q r , h E S k 

teS k ,t^h r£S k 

Notice that due to (intra-coalitional) symmetry, the following must hold 



/ <?i = <?2 = 
q s +i = q s +2 



q s = yo \ 

-- q s + Sl = yi 



\ qi*+i = ■ ■ ■ = q n = Vj J 



j'-i 



where i* — s + ^ s w . Letting^ s = s , the system to solve for is 



w=l 



( 2y = a-c- 2>y(s - l)y - y{s x y x + s 2 y 2 H h \ 

2y x = a-c- 2y(s x - l)y x - >y(s y + s 2 y 2 H h 

\2% = a - c - 27(sj - l)yj - 7(s ?/o + s x y x H h Sj-1%-1) / 

Considering zth and fcth equations of ([3]) we have 



(2) 



(3) 



2(2/< - yfc) = 7(sfc - 2)y fe - yfa - 2)y t y k 



s ^k= Yl 



k=0,k^i 



= ^(2 + 7^-27) 

7 s fc -2 7 + 2 

■s fc ?/i(2 + ysj - 27) 
7 s fc -2 7 + 2 



(4) 



Multiplying by 7, using kth equation of (JB]) and the first equation of 
we get, 



a — c 



y 



1 2[l + 7 ( Si -l)]+ 7 A 



i = 0, 1, j 



(5) 



where = ^ ^^-27+2^ • Observe that A { > (due to condition 



if). 



^rom now on we will use both s and so to denote the number of agents in S. 
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Let us now compute the worth of S. Recall that 



(S) = J^(a - qi - l( ^2 qi + ^2 q r ) ~ c)g< 

i€S l£S,tyi r=s+l 

j 

= s (a-y - 7(s - l)y - 7 ^ SkVk ~ c "> y ° ^ 



k=l 



Define = 73^ — 27+2, k — 0, 1, j. By using (j4]) and ([5} for i — 0, and 
the multiplicities of g's for each y^ in we get the following two equations 



J n 3 J 

k=l r=s+l k=l k k=l k 

J2 y°= E » = ( s o-i)^ (8) 

zes\{o} zes\{o} 

where C = 2[1 + 7(s - 1)] + 7 £ f"A . Using f l6ll71l8|) we get the theo- 

k=i k 

rem. □ 
Using Theorem 1 we have the following 



Corollary 1 When the grand coalition forms, the total worth of the network 
is 



v(N) 



n(a — c) 2 



4(1+ T (n-1)) 



Corollary 1 can be very useful in the following sense. Since, upon cooper- 
ation, the agents split the profit equally, when the grand coalition forms each 
of them will receive This means that no agent would accept deviating 

from the grand coalition and join a smaller one if he did not first ensure that 
he would receive at least more than with this move. So a first approach 
to the Basic Question is the following 
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Answer 1: If no agent assures a profit of at least more than ^w^i)) > then 
no agent likes to deviate and thus the grand coalition forms and the network 
does not break. 

When the grand coalition forms it is said that the core of the game is 
non-empty and since we would like the whole network to be stable and not 
to break into disconnected components, we have to characterize the set of 
coalitional beliefs that support core non-emptiness. So it is of special interest 
to study the core of the above game. This is the subject of the following 
section. 



4 The core 

Before saying anything about the core of the game, let us examine the impact 
of the distribution of (s 1; • • • , Sj) on vj 1 (S). This is useful in case agents in 

5 need to follow a trend in their reasoning. When 7 e (0, 1) we have the 
following 



Proposition 1 For a fixed j , the optima ofvj 3 (S), w.r.t. (s\,--- ,Sj), are 

(i) min when Sj = ^^j^, 1 < i < j 

(ii) max when s, = 1, in all but one value h, and Sh = n — s — (j — 1), 

he{i,---,j}. 

Proof: From v?{S) is min when Co is max which happens when Yl it 

k=l k 

is max which happens when Si = 1 < i < j, because 



E 



E 

k=i 
i-i 

E 



+ 



1 



k ^ 7 s fc - 2 7 + 2 ^ 7 s fc -2 7 + 2 7Sj -2 7 + 2 

1 

+ 



1 



7 s fc - 2 7 + 2 ■ ^ 
k=1 liji - s - J2 s k) ~ 27 + 2 

k=i 



(9) 
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Let h(si, s 2 , • • • , Sj-i) denote the right hand side of (jUJ). To find the vector 
of (si, that minimizes we need to solve the system 



dh(s 1 ,s 2 , ..;Sj-i) 



ds 



A- 



0, fe = l,2,...,j-l (10) 



Straightforward calculations lead to the solution si = • • • = s 3 -_i = IL p 
(and hence Sj = so we have (i). In a similar way we can also prove (ii). 
□ 

Proposition 1 gives the deviating agents a first belief about their potential 
worth 



Answer 2: If the number of coalitions that outsiders form is fixed, say j, 
then the worth of the deviating agents, s, is minimized (hence the network is 
less likely to break) when the n — s agents split equally among the j coalitions; 
and the worth of s is maximized when j — 1 coalitions have one member and 
one coalition has n — s — (j — 1) members. 



The above answer gives in a way an incentive to the deviating agents, 
meaning that a coalition of agents has a lower incentive to deviate when its 
opponents are split equally among j (see Fig. [I]). 

Another look at how agents in S might reason is given by the following 

Proposition 2 When 7 = 1, if a coalition S believes that the n — s outsiders 
will form more than j*(n, s) = 2(y / ^ — 1) coalitions, then S will not deviate 
from the grand coalition. 

Proof: Before giving the proof we make the following observation. As said 
earlier, since the agents upon cooperation split the profit equally, they know 
that when the network does not break they are going to receive each. On 
the other hand, agents belonging to a deviating coalition S, after calculating 
their worth, know that upon deviation they are going to receive each. 
So if EM > m y then no agent in S would like to deviate. Now returning to 
the proof, from <^ for 7 = 1 we get = s °2+j) > < i < j. Hence the value 
of S is independent of the size of coalitions of the outsiders but depends only 

on their number, i.e. vJ J (S) = (jj+2j ■ The core is then non empty if for 

all S, the inequality ^p- > ^p- holds, or if ^ > s q+ 2 ) 2 • ^ e ^ as ^ i nec L ua lity 
holds iff j> j*(n,s) = 2 L/^-l). □ 
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Proposition 2 implicitly provides agents with another belief in the special 
case where 7 = 1 



Answer 3: In the special case where 7 = 1, agents do not have to worry 
about what the rest will do, meaning that they do not have to worry about 
how the rest are going to split. They only have to worry about how many of 
them there are, i.e. their total number. 

A more thorough look at how agents in S might think is given by the 
following 

Theorem 2 Assume 7 G (0, 1]. There exists a j*(n, s, 7) , such that the core 
is non-empty for all j > j*(n, s, 7) and all corresponding Vj. 

Proof: We seek conditions for the inequality > Vj ^ to hold: 

^ J n — s 

C > 2^(1+7^-7X1 + 73-7) 
j 

or 2(1 + 7s - 7) + 7 V ^A > 2y/(l + jn - 7 )(1 + 7s - 7) 

— ' At. 

fc=i K 

or y — ™ — , > 2 ( JUj^H _ A /(1 + ) = c 

^ 7Sfc + 2(l- 7 )" VVl + 73-7 y 1 + 7^-7 

Since < 7 < 1 the sum can not exceed j, so for j*(n, s, 7) = ( the core 
is non empty for all j > j*(n, s, 7). 

We now have to show that n — s > £. But it can be easily proven by 
induction on s, < s < n that for fixed n, n > 1 and 7 e (0, 1], ( < n — s. 
And since for every s < n, ( > 0, we have the theorem. □ 

Theorem 2 gives, in a computational efficient way, a belief as to how 
agents in S might think when considering deviation from the Network and 
thus constitutes another answer to our Basic Question (see also Fig. [Q: 

Answer 4: When 7 e (0, 1], the network does not break provided that agents 
in S believe the outsiders will form a structure with a sufficiently large number 
of coalitions (> j*). 
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Using the formula for j*(n, s, 7) we can prove proposition 2 in a different 
way by plugging 7 = 1 and get j*(n, s, 1) = CIt=i — 2(a/^ — 1) as expected. 
Another perspective of the beliefs of agents in S is given by the following 

Theorem 3 If 7 G (—1,0) and condition K holds, then the core is non- 
empty for all j — 1, 2, • • • , n — s and all Vj . 

Proof: The inequality ^ > holds iff 

^ J n — s 



2 +7 (i + x ~ 7 ) y^ >2 V( 1 +^-^)( 1 + ^E5 

l + 7s-7^A fc - (1+75-7) 
or using the definitions a = 1 + 7(5 — 1), v = 1 + 7(71 — 1), it holds iff 



Since 7 > — V, it suffices to show that 

' n— 1 ' 



-1 2(v/z7 - ^fo)^fo 2(n - l)(a - y/au) ^ s k 
> ^ — — — or 1 > > — 

3 

The maximum value of the term Yl j~ appears at Sh — 1 for all but one 

fc=i k 

h (remember that now 7 < 0). It suffices then to show that the left hand 
side of the last inequality is greater than the corresponding maximum value 
of the sum. So we must show 



2{n - 1)(<t - Jw) > j-1 + n - s - (j - 1) 



A -7 + 2 7 (n-s-(j-l))-2 7 + 2 



2(n - l)(a - Jau) 2(n - l)(a - Jov) 

But A = 7s - 2 7 + 2 < 2 - 2 7 so - x '- > — J K - v '- 

A 2-27 
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2(n - l)(o - ygg i ~ 1 n - g - (j - 1) 

Or that ; > ; ; rr 11 

2(1-7) 2-7 7 (n- s -(j-l))-27 + 2 1 } 

Since j^f- > jE~, instead of inequality (TTTj) we can prove that 



(n - l)(a - y/au) - (j - 1) n - s - (j - 1) (u) 

1-7 7(n - s - (j - 1)) - 2 T + 2 1 ' 

„ , , . . n — s — (7 — 1) n — s — (7 — 1) 

But 7(71 - s - (j - 1)) > -1 so n U J > 



-I-27 + 2 7(71 - s - (j - 1)) - 2 7 + 2 

t , , r xt™ (" - ~ \/^) ~ (j-jj ^ n-s-(j- 1) 

Instead 01 ([121) we can prove > 

1 — 7 1 — 27 

(77 - l)(cr - vW) - (j - 1) n-s - (j - 1) 

or > 

1 — 7 1 — 7 

n - s - (j - 1) n - s - (j - 1) 

because > 

1 — 7 1 — 27 

i\ — g 11 — — ^ 5 — 1 

So must show that a — \fov > = = 1 

Ti—1 n — 1 n — 1 



or 1 + T ( S - 1) - TA / (- + (s - 1))(- + ( n - 1)) > 1 - ^4 

7 7 77 — 1 



or 7(3 - 1) - 7a/ (- + (*- 1))(- + (n - 1)) > 

V 7 7 77—1 

Since 7(3 — 1) > — • 2 5i> it suffices to show that 



7(5 - 1) - 7\/(- + (s- 1))(- + (n - 1)) > 7(s - 1) which holds. □ 

V 7 7 

Theorem 3 gives us another answer to the Basic Question (see also Fig. |2]): 



Answer 5: The network never breaks when 7 G (—1,0) and 7 > -— jj ; so no 
group of agents will consider deviating from the grand coalition under these 
conditions. 
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5 Conclusions 



In this paper we forced a set of n agents to compete under a differentiated 
Cournot competition and by imagining their full cooperation as a complete 
graph we studied the various beliefs that support core non-emptiness and 
thus network stability. Fixing the number of coalitions that outsiders form 
to say j coalitions, we proved that the worth of the deviating agents, s, is 
minimized (hence the network is less likely to break) when the n — s agents 
split equally among the j coalitions; and the worth of s is maximized when 
j — 1 coalitions have one member and one coalition has n — s— (j — 1) members. 
Given the above, we proved that when 7 > the network does not break, 
provided the agents of a deviant coalition believe their opponents will form 
a sufficiently large number of coalitions. On the other hand, if 7 < and 
7 > the network does not break irrespective of the beliefs of the deviant 
coalition, so no agent will consider deviating. Finally, we proved that when 
7 = 1, the deviating agents, in order to calculate their worth and thus decide 
what to do, must only worry about how many coalitions are going to be 
formed by the outsiders. 
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Appendix 




Figure 1: On the left, when 7 £ (0, 1) and for a fixed j, the worth of S 
is maximized when the outsiders, N \ S, split in all coalitions but one into 
singletons. In this figure we have the case where n = 46, s — 4, and j = 6. 
Respectively, on the right the worth is minimized when they split equally 
among the j = 6 coalitions, having = 7 agents each. 




Figure 2: On the left, when 7 £ (0, 1] the network does not break provided 
that agents in S believe the outsiders will form a large > j* number of 
coalitions. In this figure we illustrate the case where n = 46, s — 4, and 
7 = 0.9, for which j*(46,4, 0.9) ~ 4.57. So when the outsiders split into 5 
coalitions the network does not break. On the right, when 7 £ (—1,0), the 
network does not break irrespective of what S might think. 



13 



References 



[1] Mavronicolas, M., Papadopoulou, V. and Spirakis, P. Algorithmic Game 
Theory and Applications. In Handbook of Applied Algorithms: Solving 
Scientific, Engineering, and Practical Problems; N., Nayak, L, Stojmen- 
ovic Eds; Wiley-IEEE Press, 2008. 

[2] Dorogovtsev, S. N., Mendes, J. F. F. Evolution of networks. Advances in 
Physics 2002, 51, 4, Taylor and Francis (2002) 

[3] Sandhlom T., Lesser V. Coalitions among computationally bounded 
agents. Artificial Intelligence (Special issue on Economic Principles of 
Multi-Agent Systems), 1997, 94, 1-2 , 99-137. 

[4] Sandholm, T., Larson, K., Andersson M., Shehory O., and Tohme F. 
Coalition structure generation with worst case guarantees. Artificial In- 
telligence 1999, 111, 1-2, 209-238. 

[5] Sundararajan A. Local Network Effects and Complex Network Structure. 
The B.E. Journal of Theoretical Economics 2008, 7 

[6] Kirman, A., Markose, S., Giansante, S., and Pin, P. Marginal contribu- 
tion, reciprocity and equity in segregated groups: Bounded rationality 
and self-organization in social networks. Journal of Economic Dynamics 
and Control 2007, 31. 

[7] Rubinstein, A. Modeling Bounded Rationality, MIT Press, 1997 

[8] Jackson, K A Survey of Models of Network Formation: Stability and Effi- 
ciency Group Formation in Economics: Networks, Clubs, and Coalitions, 
Cambridge University Press, 2005 

[9] Nisan, N., Roughgarden, T. , Tardos, E. and Vazirani, V. Algorithmic 
Game Theory, Cambridge University Press 2007 

[10] Immorlica N., Markakis E. and Piliouras G. oalition Formation and Price 
of Anarchy in Cournot Oligopolies. In 6th Workshop on Internet and 
Network Economics, LNCS, 2010, Volume 6484/2010, 270-281 



14 



